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Abstract: We address the question of optimization of the biomass long term productivity 
in the framework of microalgal biomass production in photobioreactors under the influence 
of day/night cycles. For that, we propose a simple bioreactor model accounting for light 
attenuation in the reactor due to biomass density and obtain the control law that optimizes 
productivity over a single day through the application of Pontryagin's maximum principle, 
with the dilution rate being the control. An important constraint on the obtained solution 
is that the biomass in the reactor should be at the same level at the beginning and at the 
end of the day so that the same control can be applied everyday and optimizes the long term 
productivity. Several scenarios are possible depending on the microalgae's strain parameters 
and the maximal admissible value of the dilution rate: bang-bang or bang-singular-bang 
control or, if the growth rate of the algae is very strong in the presence of light, constant 
maximal dilution. A bifurcation diagram is presented to illustrate for which values of the 
parameters these different behaviors occur. 
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Optimisation de la production de biomasse par un 
photobioreacteur en utilisant la lumiere naturelle 

Resume : Dans ce rapport, nous abordons la question de I'optimisation de la productivite 
a long terme de la biomasse microalgale dans le cadre d'une production en photobioreac- 
teur sous I'influence du cyle jour/nuit. Pour cela, nous proposons un modele simple de 
bioreacteur representant I'attenuation de la lumiere dans le reacteur due a I'auto-ombrage 
de la biomasse. Nous obtenons une loi de commande qui utilise le taux de dilution comme 
controle et optimise la productivite sur une seule journee par I'application du principe du 
maximum de Pontryagin. Une contrainte importante a la solution obtenue est que la bio- 
masse dans le reacteur devrait etre an meme niveau an debut et a la fin de la journee pour 
que le meme controle puisse etre applique tous les jours afin d'optimiser la productivite 
a long terme. Plusieurs scenarios sont possibles en fonction des parametres du modele de 
croissance de la micro-algues et de la valeur maximale admissible du taux de dilution: com- 
mande bang-bang ou bang-singuliere-bang ou, si le taux de croissance des algues est tres 
fort en presence de la lumiere, dilution maximale constante. Un diagramme de bifurcation 
est presente pour illustrer pour quelles valeurs des parametres ces differents comportements 
se produisent. 

Mots-cles : Controle optimal, systemes biologiques, modelisation 
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1 Introduction 

Microalgae have recently received more and more attention in the frameworks of CO2 fixation 
and renewable energy [3 [5] . Their high actual photosynthetic yield compared to terrestrial 
plants (whose growth is limited by CO2 availability) leads to large potential algal biomass 
productions in photobioreactors of several tens of tons per hectare and per year |2- 

The objective of this paper is to develop an optimal control law that would maximize the 
photobioreactor yield, while taking into account that the light source (z.e the primary energy 
source) that will be used is the natural light. The light source is therefore periodic with a light 
phase (day) and a dark phase (night). In addition to this time- varying periodic light source, 
we will take the auto-shading in the photobioreactor into account: the pigment concentration 
(mainly chlorophyll) affects the light distribution and thus the biological activity within the 
reactor. As a consequence, for a too high biomass, light in the photobioreactor is strongly 
attenuated and growth is low. 

It is therefore necessary to develop a model that takes both features into account in order 
to develop the control law, where the substrate concentration in the input (marginally) and 
the dilution rate (mainly) will be used. This model should not be too complicated in order to 
be tractable and should present the main features of the process. Since we want to develop 
a control strategy that will be used on the long run, we could choose an infinite time-horizon 
measure of the yield. However, we rather took advantage of the observation that, in the 
absence of a discount rate in the cost functional, the control should be identical everyday 
and force the state of the system to be identical at the beginning of the day and 24 hours 
later. We therefore opted for optimizing a cost over one day with the constraint that the 
initial and terminal state should be identical. 

The paper is structured as follows: first, we present the model dealing with both substrate 
limitation, light attenuation and light periodicity; then biomass productivity optimization 
is presented in a constant light environment. The solution to the periodic light problem is 
then presented. Finally, numerical results are presented with a bifurcation analysis. 

2 A photobioreactor model with light attenuation 

Micro-algae growth in a photobioreactor is often modelled through one of two models, the 
Monod model [H] or the Droop Model (2]. The latter is more accurate as it separates the 
process of substrate uptake and growth of the microalgae. The former gives a reasonable 
representation of reality by coupling growth and uptake, and is more convenient for building 
control laws since it is simpler. For sake of simplicity we will introduce the problem with the 
Monod model, but the presented results are similar with the Droop model when considering 
the working modes where nutrients are not limiting growth. The Monod model writes: 




D{s„, - s) - 
iy{s)x — Dx 




(1) 
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where s and x are the substrate and biomass concentrations in the medium, while D is the 
dilution rate, .Si„ is the substrate input concentration and k is the substrate/biomass yield 
coefficient. We will depart from this model in two directions. First, we introduce respiration 
by the microalgae: contrary to photosynthesis, this phenomeneon takes place with or without 
light; from a carbon point of view, it converts biomass into carbon dioxyde, so that we 
represent it as a —px term in the biomass dynamics. Secondly, under the hypothesis of an 
horizontal planar photobioreactor (or raceway) with vertical incoming light, we represent 
light attenuation following an exponential Beer-Lambert law where the attenuation at some 
depth z comes from the total biomass xz per surface unit contained in the layer of depth 
[0,z]: 

lixz) = loe-'^-' (2) 

where Iq is the incident light and a is a light attenuation coefficient. In microalgae, as we 
proposed in Q chlorophyll is mostly the cause of this shadow effect and, in model ((T]), it 
is best represented by a fixed portion of the biomass [l]. Finally, the light source variation 
will be introduced by taking a time- varying incident light Io(t). With such an hypothesis 
on the light intensity that reaches depth z, growth rates vary with depth: in the upper part 
of the reactor, higher light causes higher growth than in the bottom part. Supposing that 
light attenuation directly affects the maximum growth rate the growth rate for a given 
depth z can then be written as 

i>I{xz,T) s 

V:,{S,I[XZ,T)) = 



I{xz, t) + Ki s + Ks' 

with I{xz,t) = /o(r)e-°^^ 

Then, we can compute the mean growth rate in the reactor: 

iy{s,Ia{T),x) = Y I i^^{s, I(xz,T))dz 
^ Jo 

where L is the depth of the reactor and where we have supposed that, even though the growth 
rate is not homogeneous in the reactor due to the light attenuation, the concentrations of s 
and X are kept homogeneous through continuous reactor stirring. It is this average growth 
rate that will be used in the lumped model that we develop. We then have: 

u{s,Io{t),x) = - TTZV— 73— ^d^- 



L Jo Io{T)e-''^^ + Ki s + K, 
V ^^ J Io{t)+Ki \ s 



axL \Io{T)e-°-''^ + KjJ s + Ks 
The system for which we want to build an optimal controller is therefore 

Tff = D{stn — s) - In (j^^/j^j^^^^rjrj^jj jifjc^x 



dx 
dr 



Jl. In { ^"("'H^J ^ y _ - Dt 
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However, since we want to maximize the productivity, it seems clear that the larger s the 
better, large values of s translating into large growth rates. The control Si„ should then 
always be kept very large so as to always keep the substrate in the region where « 1. 

We can then concentrate on the reduced model 

^^^In Ioi^)+Ki x-px-Dx (4) 
dr axL Io{T)e-'^''^ + Ki ^ 

which then encompasses all the relevant dynamics for the control problem. 

In order to more precisely determine the model, we should now indicate what the varying 
light will be like. Classically, it is considered that daylight varies as the square of a sinusoidal 
function so that 

/o(t) = ^max jsin ^^^^ , 

where T is the length of the day. The introduction of such a varying light would how- 
ever render the computations analytically untractable. Therefore, we approximate the light 
source by a step function: 



loir) 



lo, < T < T — hght phase 
0, T < T < T — dark phase 



In a model where the time- unit is the day, T will be equal to 1. In the following, we will 
consider T = -j, but this quantity obviously depends on the time of the year. 

Finally, we consider a last simplification to the model: instead of considering that the 
biomass growth in the presence of light has the form ^ In j^^/°+f_[jy^ , which IS an increasing 
and bounded function, we replace it with another increasing bounded function and 
obtain the model 

dx viT)x ^ 

— = px — Dx 

dr K + X 

where z^(t) = v during the light phase and at night. It is possible to show that this 
simplified model is a good numerical approximation of the original model. 



3 Productivity optimization 

The productivity problems that we will consider in the sequel will be put in a framework 
where D is bounded, so that, > 0, Dit) € [0, Z^mai]; such a bound makes sense in an 
optimal control framework since it prevents infinite values of the control, which might occur 
when harvesting the photobioreactor. In order to simplify notations, we then introduce the 
following change of time and variable (i, y) = iDmaxr, f ), which yields 

dy . ^{t)y 

-jr = y = -;— ry-uy (5) 

dt 1 + y 



where r — jy- — and u = e [0, 1] is the new control. We also have /^(t) = /i = -;7jy- 

for t e [0, rfand for t e "[T, T] (with f = D,naxf and T = D„,axT). 
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3.1 Productivity optimization in constant light environment 

In a previous work [5] , we have studied the productivity optimization of a microalgae photo- 
bioreactor with hght-attenuation in the Droop framework with constant Ught. In that study, 
since we wanted to optimize the long-term productivity, we looked for the control values for 
D and .Si„ that optimized the instantaneous biomass output flow at equilibrium, that is 

maxMj/*T^ 

u 

where V is the photobioreactor volume (assumed here to be constant). This study was 
complex because the shading was dependent on the internal substrate quota. In the present 
case, it will greatly simplify with Sin that does not need to be optimized. Indeed, for a given 
dilution u, the equilibrium of ^ in the presence of light is 

y = — — 1 

r + u 

which needs to be non-negative, so that < u < p. — r. The positivity of u imposes that 
r < fl, that is the respiration needs to be weaker than the maximal growth. For a given u, 
the productivity rate at equilibrium is then 

r + u 

whose optimum value is reached in 

Ucr = Vfir - r (6) 
which is positive because r < p. but requires 

r 

to be smaller or equal to 1 (otherwise, the optimal dilution is u = 1). This yields the optimal 
productivity rate: 

It is important to note that the equilibrium is then 

= (8) 

which maximizes the net production rate ^ ry — uy. We will use this definition of y„ 
even when it is not achievable with some Mo- < 1. 
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3.2 Productivity optimization in day/night environment 

In an environment with varying light we cannot settle for an instanteneous productivity rate 
optimization since this equilibrium cannot be maintained during the night. In essence, we 
want to optimize the long term productivity of the photobioreactor, that is we want that, 
everyday, the same maximal amount is produced. The problem that we consider is therefore 

max / u(t)Vy{t)dt 

We then need to add constraints to the solution that we want to obtain; indeed, at the end 
of the day, we want to be able to start operating the photobioreactor in the same conditions 
for the next day. This then requires that we add the constraint 

y{T) = y(0) 

We therefore are faced with the following optimal control problem 

max / u{t)y{t)dt 
"(*) e [04] Jo /Q\ 
with y ~ — ry — uy 

y{T) = y(0) 



3.2.1 Parameter constraints 

In order to solve this problem, it is convenient to observe that y{T) = y{0) cannot be 
achieved for large values of y even without considering optimality. Indeed, for all t, we have 

n — 

y < when y{t) > independently of the choice of u; therefore, an initial condition 

r 

n — 

such that y{0) > cannot be considered since necessarily y{T) < y{0) in that case. We 

then know that, for admissible initial conditions below that threshold, y{t) will stay below 
this threshold for all times. It also implies that, whenever u{t) = for such solution with 
t € [0,f), y > because y{t) then tends toward 

We could make this bound stronger by noticing that, for a given j/(0), the largest value 
of y{T) that can be achieved is reached by taking u{t) = for all times; indeed, at any time, 
applying u{t) > implies that y is smaller than if u{t) — were applied. If the value of 
y{T) corresponding to u{t) = is smaller than t/(0), then the corresponding initial condition 
cannot be part of the optimal solution. Solving ([5|) with u{t) = in the interval [O,?], by 
separating the variables yields 

rln(yn)^,,J-^-^i] + ym 

\ yo J V iJ.-r{l + yo) J ^ ^ 

r(/2 — r) 
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where we denoted y{0) as yo. Trivially, the integration of (0), for the dark period {u{t) ~ 0) 
on the interval [T,T], yields 

yiT) ^ ,(T)e-(^-^) 
so that, introducing this equation in the previous one, we get 



\ ya J \ fi-r{l+yo) ^ 

r{pL — r) 



■=T 



The equality y{T) = ?/o is then achieved with uit) = when solving this last equation for 
j/o with y{T) — y^, which yields 

^(p.T-rT) 1 

fj, — r ei^^ ' — I 
r (,—iP--r) - 1 

For larger values of j/Oi we have y{T) < j/o independently of the choice of u{t)\ for smaller 
values of yo, there exist control functions u{t) that guarantee y{T) = j/q. The constraint 
/i > r, which is necessary for growth to occur in the light phase guarantees that the first 
fraction and the denominator of the second one in yomax are positive. We then need to add 
the constraint 

M>f (10) 

to ensure the positivity of yomax and so the possibility of the existence of a solution to the 
optimal control problem Note that, in the case where T ^ -j, this simply means that 
p. > 2r. 

It is also interesting to see that, if a constant control u{t) = 1 is applied, a periodic 
solution is obtained for 

which can be positive ii jl > (''"y-)^ , Por any value of ya smaller than yomin , any control law 
would force y{T) > yo. As a consequence, yo, solution of problem should belong to the 
interval [yomin 

3.2.2 Maximum principle 

In order to solve problem we will use Pontryagin's Maximum Principle (PMP, [TU]) in 
looking for a control law maximizing the Hamiltonian 



H{x, u, A, t) = 



\ f f ^(^) 1 1 , 

A r ] y — uy ] + uy 
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with the constraint 



u(t)y 

y = i+f -ry-uy 



A = A 



{l+yy- ' ' ' 

In addition, we should add the constraint 

A(T) = A(0). 

Indeed, the solution of the optimal control problem is independent of the reference initial 
time: defining x{t) = x{t — T), u{t) = u{t — T), and X{t) = X{t — T) for values of t larger 
than T, we have that x(t), u(t) and therefore X(t) are unchanged if we consider the interval 
[to,T + to] (for < to < T) rather than [0,T]. Since A(t) is continuous inside the interval 
when considering the problem over [to,T + to], it is continuous in time T and A(0) = A(r) 

We see from the form of the Hamiltonian that 

ou 

so that, when A > 1, we have u = 0, when A < 1, we have u = 1, and when A = 1 over some 
time interval, intermediate singular control is applied. 

In the sequel, we propose candidate solutions to the PMP by making various hypotheses 
on the value of A(0) = Xq. 

Bang-bang with Ao > 1: With Ao > 1, we have it = at times and T. At any given 
time < t < T" before the first switch, the solution of ([5|) yields 



yo J V fj.-r{l + yo) 

r{pL — r) 



(11) 



and, as stated earlier, y{t) is increasing because y(0) < yomax < ■ The constancy of the 
Hamiltonian during the light phase then imposes that 

^(""('>(T4(0--)^'°»(TTi;-) <'^' 

for all times t G {0,T) such that u{t) = 0. A switch to 1 then needs to occur between time 
and T (otherwise the payoff would be 0) and this switch cannot take place in the dark 
phase. Indeed, in that zone, as long as u{t) = 0, the A dynamics are 

A rA 



with X(t) > 1. The adjoint variable is therefore an increasing function in that region, and 
cannot go through A = 1. We will use this impossibility of switch from to 1 in the dark 
phase several times in the sequel. 
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For the solution that we study, a switch then needs to take place at time toi in the (0, T) 
interval and for y{toi) ~ yoi and A(ioi) = 1 solutions of (fTT|) - ([T^ . 



2/0 / V - r(l + yo) 

"(/2 - r) 



= toi (13) 



yoi [t-I^ r] = Xoyo ( r) (14) 

Another constraint that appears at the switching instant from u = to w = 1 is that 
A < 0, which amounts to (^ifyyi > r or y < y„ (see ([5])). After time toi: 2/(0 then converges 
increasingly or decreasingly toward 

Due to the constancy of the Hamiltonian, another switch can only take place at time t 
before time T if 



l + 2/(*) / VI + 2/01 

where we have used the fact that \{t) = A(foi) = 1 at the switching instants. This can 
only happen for two values of y{t): y{t) = yoi and another value y(t) — ^ which is 

larger than j/o-- Since y{t) was converging to with u{t) ~ 1, y(i) cannot go through 

2/01 again unless ypi = . In this last case, by considering the A dynamics, we see that 

another switch could only take place if u{t) = 1 solves the conditions for being a singular 
solution to the optimal control; this will be handled later. Generically, a single switch can 
then only take place inside the interval (0, T). 

The solution then reaches the time T with {y{t), X{t)) — {y, A) that solve the same kind 
of equations as ((TT]) and : 



2/01/ V/i- (r + 1)(1 + yoi) 

(r + l)(^-r- 1) 



T-toi (15) 



\y[-^-r-l +y = yoi{-^ r (16) 

Vl + 2/ / Vl + 2/01 / 

Since A(T) < 1 and A(r) > 1, a switch from u = 1 to u = then needs to take place inside 
the (T, T) interval. With the dynamics being in the form 

y = -{r + l)y A = (r + 1)A-1 

another switch can only take place if A > ^r^; otherwise A cannot go through 1 again. The 
switching point (iio,2/io) is then characterized by 

yiO = ye'('-+l)(*--^) (17) 
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A(iio) = 1 = Ae('-+i)(*i°-^) - (18) 

r + 1 

After this switching, the dynamics become 

y — —ry X — rX 

so that no other switch can take place and these dynamics and the constraints y(T) = yo 
and A(T) — Xq impose that 

yo = yioe-'^^^-*-) (19) 

Ao = e'^(^-*i«) (20) 

In the end, we have a system of 8 algebraic equations 
(|13p - (|20p with eight unknowns, which we solve numerically. 

Even though, we were not able to lead this study analytically all the way to the end, we 
have shown the qualitative form of the solutions analytically. It is made of four phases: 

• Growth with a closed photobioreactor until a sufficient biomass level is reached 

• Maximal harvesting of the photobioreactor with simultaneous growth 

• Maximal harvesting of the photobioreactor with no growth until a low level of biomass 
is reached 

• Passive photobioreactor: no harvesting, no growth, only respiration 

The first two phases take place in the presence of light, the other two in the dark. In phase 
3, harvesting of as much biomass produced in the light phase as possible is continued while 
not going below the level where the residual biomass left is sufficient to efficiently start again 
the next day. 

Bang-singular-bang with Ao > 1: 

We will first look at what a singular arc could be. For that, we see that ^ = 1 — A 
should be over a time interval and compute its time derivatives. 

d_(dH\ fijt) 
dt[du)^,^,~'il + yr^'^ 

When fi{t) ~ 0, that is in the dark phase, no singular arc is thus possible. When ij,{t) = jl, 
this derivative is equal to zero when y ^ y^ defined in The singular control is then the 
control that maintains this equilibrium, that is Ua- = y/p^ — r defined in ^ . This control is 
positive thanks to (fTU)) but it is smaller or equal to 1 only if 

(^+1)^ . ^ 

M < ^ (21) 
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No singular control can exist otherwise. When a singular branch appears in the optimal 
solution, it is locally optimal because the second order Kelley condition 

d f d^ dH\ 2A/i ^ g 



du \dT^ du J (1 + y) 

is satisfied on the singular arc [7]. 

The construction of the solution is very similar to that in the purely bang-bang case. 
Similarly, a switch needs to occur in the interval {0,T). This switch can be from u = to 
u = 1 or from u = to u = and should occur with y < Ua- order to have A < 0. In fact, 
if a switch first occurs to u = 1, an argument identical to the one in the previous section 
shows that no switch back to can take place before T; this same argument can in fact be 
used to show that no switch to u = Ua- can take place either since: in both cases, A should 
get back to 1, which we show to be impossible. 

A switch from to u„ then takes place once A = 1 at (too-, Va)- Equations (fTT|) - P^ can 
then be used to identify this switching instant: 



yoj \^J■-ril + yo) 

r(fl — r) 



(22) 



From there, X{t) ~ 1 and y(t) ~ y„ for some time. This could be until t = T, followed 
directly by u = in the dark phase but, more generically, the singular arc ends at time 
t^i < T, where a switch occurs toward u = I. From then on, things are imchanged with 
respect to the bang-bang case. The equations that define the transitions from t^i to T are 
similar to and P^ : 



yaj_ {r + l){l + y„) 

{r + l){fL - r - 1) 



T - (24) 



A.-(^-.-l)+.-..(^-.) (25) 

The remainder of the solution is unchanged with respect to the bang-bang one, so that 
we can compute the solution by solving system ([T7)) - (pn)) and (|22p - (P5|) of eight algebraic 
equations with eight unknown variables. 

Again, the analytical approach has helped us identify the qualitative form of the optimal 
productivity solution. It now contains five phases: 

• Growth with a closed photobioreactor until a sufficient biomass level is reached 
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• Maximal equilibrium productivity rate on the singular arc 

• Maximal harvesting of the photobioreactor with simultaneous growth 

• Maximal harvesting of the photobioreactor with no growth until a low level of biomass 
is reached 

• Passive photobioreactor: no harvesting, no growth, only respiration 

For this form of solution, we see that maximal instantaneous productivity is achieved 
during the whole second phase, when the singular solution occurs. 
Solution with Aq < 1: 

Such a solution would mean that harvesting takes place during the whole dark phase 
because no transition from u = to u = 1 can take place in this phase, as we have already 
shown. Two possibilities then occur: either m = 1 all the time or switches from u = 1 to 
u ^ or and then back to it = 1 take place in the interval (0, T). 

In the latter case, the first switch from u = 1 to u = can only take place with y > y„ 
because of the constraint that A > with A = 1 at that moment. Then, when the control 
u = is applied for some time, the solution y{t) is increasing. We also have that the switch 
from li = to w = 1 can only take place with y < because of the constraint that A < 
with A = 1 at that moment. This is in contradiction with the fact that y{t) was increasing 
from above y„. 

We can also show that no strategy in the (0,T) interval can have the form u = 1 ^• 
Mo- — ^ w = or 1. Indeed, in order to reach the singular arc with m = 1, a solution should 
be coming from above it. If the switch that takes place at the end of the singular phase is 
from Wo- to 0, y{t) will increase and there should be a subsequent switch from to 1 which 
is impossible with y{t) > y^- If the switch that takes place at the end of the singular phase 
is from Ua to 1, y{t) will decrease all the time between t^i and T, which is in contradiction 
with the fact that we had y{0) > y^. 

The only potential optimal control in that family is therefore u{t) ~ 1 for all times. 
Using the expressions computed previously, this control can be a candidate optimal control 
law only if yo ~ yomin as we have seen earlier and the complete dynamics should satisfy: 




(26) 



y = yoe 



{r+l){T-T) 



(27) 



Ao = Ae('-+i)(^-^) 



g(r+l)(T-T) _ I 



(28) 



r + 1 



with Aq < 1 and A < 1. 
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4 Bifurcation analysis 

In this section, we will consider fixed values of all parameters except of 9 and p. We build 
a bifurcation diagram for these two parameters by identifying in which region no solution 
is possible (where ([TO)) is not satisfied, it is below the solid black line on Fig. 1), and where 
the optimal solution is bang-singular-bang (Fig. 1, inside the blue curve), bang-bang (Fig. 1, 
outside the blue curve and above the solid black line), and constant at value 1 (see Fig. 2). 
But the last case is only realized for extremely large values of P. We see that the region where 
singular control can exist is smaller than what is defined by condition (j2ip . This is due to 
the fact that, though the singular control is possible, there is not enough time for the control 
to reach that level (see Fig. 3(C)). For larger values of D, no singular control is possible and 
the optimal solution in the light region goes toward the equilibrium corresponding to u ~ 1 
(see Fig. 3(A)). In that case, as well as in the bang-singular-bang case, the solutions go to 
the optimal solution of the constant light problem (Fig. 3(B)). 

5 Conclusions 

We have shown that, because of the day-night constraint, the productivity rate cannot 
be as high as it could have been without it. However, when the maximal growth rate is 
sufficiently larger than the respiration rate, we manage to have a temporary phase where 
the productivity rate is at or near this level. The maximal harvesting at the end of the 
light phase and at the beginning of the dark phase minimizes the biomass during the dark 
phase and, consequently, the net respiration. If the maximal growth rate is very large, the 
optimal solution consists in constantly applying maximal control because the biomass that 
is built-up in the light phase needs to be harvested even during the night. 
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Figure 1: Bifurcation picture for D^ax = 12, k = 1, T = 1, T = T/2. The solid black line 
is £/ = npT jT (see (|10p ). the dashed line \^ v — k{p + DmaxY / P and it is related to ([7]). 
Optimal patterns for A, B and C are shown on Fig. 3 
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Figure 2: The region E with optimal constant control u 
is connected with Fig. 1 



1. Below this region, this diagram 
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Figure 3: Different optimal patterns: (A) P = 14. (B) D = 36, (C) P = 64; p = 5, Dmax ~ 12, 
K = 1, T = 1, T = r/2. Red: u = 0, Blue: it = 1, Green: intermediate control u e [0, 1]. 
Magenta line indicates the level x — nya- (see (O) 
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